Evaluation for Artificial Intelligence (AI) in Health and Care Award

The award is split into phases based on the readiness of the AI technology.

  • Phases 1 – 2 accelerate promising ideas and products that are pre-commercialisation and have yet to receive market authorisation.
  • Phase 3 develops first real-world testing in health and social care settings to establish evidence of effectiveness and efficacy.
  • Phase 4 will identify promising products which are ready for robust evaluation across multiple real-world test sites.

These evaluations help build an evidence base to inform recommendations for national roll-out and, where relevant, National Institute for Health and Care Excellence (NICE) guidance.

Phase 4 Evaluations

Independent evaluations are commissioned for all our Phase 4 Award winners and will be published upon completion. These evaluations fill key evidence gaps for relevant published evidence standards frameworks and accelerate local and national adoption. Evaluations will focus on:

  • Accuracy
  • Safety
  • Effectiveness
  • Value
  • Fit with Site
  • Implementation
  • Feasibility of scale up
  • Sustainability of scale up

The AAC will also provide a model for pragmatic, late-stage, real-world evaluation of AI and  help better understand challenges and solutions for AI evaluation.

The AAC will also continue to work with regulatory bodies, arm’s length bodies and industry partners to develop and identify frameworks for fast and safe deployment of AI health and care technologies into the NHS.

Evaluation Partner Group

In 2021, the AAC set up an AI Award Evaluation Partner Group to work with Phase 3 & 4 technology companies on their evaluations. This group of experienced health technology evaluators will develop and deliver robust empirical evaluations in line with NICE and the UK National Screening Committee (UKNSC).

Evaluation Partner Group members:

  • KiTec
  • University of Leeds
  • iCAIRD
  • NENC AHSN
  • LSBU
  • The Strategy Unit
  • Unity Insights
  • Swansea University
  • University of York
  • Cambridge Centre for Health Services Research
  • Med City
  • UCL
  • Hardian Health

The Evaluation Partner Group will provide independent peer review of selected Phase 3 projects and evaluation delivery for Phase 4 winners. When appointed to a specific technology, they are individually known as Technology Specific Evaluation Teams (TSETs).

Evaluation Advisory Group

Our Evaluation Advisory Group (EAG) helps ensure robustness of the evaluation plans proposed by the Evaluation Partner Group members. They also advise on the selection of TSETs and on the development of ‘Evaluation Learning’ documents.

The EAG comprises of experts in:

  • AI evaluation and medical technology assessment
  • AI regulation
  • AI implementation and adoption
  • Patients and public involvement (PPI)

We are looking to recruit new members to the EAG through an expression of interest process. Please join the AI Lab Virtual Hub to find out more about the expertise we are looking to recruit and view the Terms of Reference for the EAG, which contains the full list of current members. To apply, please complete and return the expression of interest form to us by the 5 November 2021 via england.ai.award-uk@nhs.net .