ISO 8800: Specifying Performance Metrics and Acceptance Criteria for ML Models

Date
2026-11-03
Location
Online
Host
Zach L

About this event

A live 30-minute expert session on Specifying Performance Metrics and Acceptance Criteria for ML Models (ISO 8800 — Safety & Artificial Intelligence). What We'll Cover: Where metric specification sits between AI safety requirements and V&V planning in the ISO 8800 lifecycle The core method, step by step: hazard-weighted metric selection, operating-point choice, threshold derivation from risk targets How metrics map to ISO 8800 performance requirements and the acceptance criteria specification produced Common mistakes: single aggregate accuracy hiding per-class recall failures on the highest-severity classes The metric-to-safety-goal rationale and confidence intervals auditors examine Related topics: iso 8800 · iso pas 8800 · ai safety · road vehicles · automotive ai · functional safety · machine learning safety · performance metrics · acceptance criteria · precision recall · false negative rate · thresholds · risk acceptance · metric selection Critical Systems Analysis provides embedded functional safety consulting for ISO 8800 — Safety & Artificial Intelligence. Learn more: https://criticalsystemsanalysis.com Partner with us: https://meetings.hubspot.com/benjamin-twombly/strategic-partnerships

Topics

Registration

View event page

About Functional Safety Foundations

This online session delivers expert-led instruction on the regulatory landscape and implementation approach for Functional Safety Foundations.

The cross-sector fundamentals underlying every functional safety standard: risk as severity × likelihood, the safety function concept, integrity levels, the safety lifecycle, and the split between random and systematic failures.

What it regulates

Shared vocabulary and reasoning: hazard → risk → risk reduction allocation → safety requirement → verified implementation → maintained integrity in operation.

Who must comply

Everyone entering the field — the conceptual base of the entire catalog.

Key requirements of Functional Safety Foundations

  • Hazard and risk fundamentals
  • Safety function anatomy: sensor-logic-actuator with defined safe state
  • Integrity ladders (SIL/PL/ASIL/DAL) as risk-reduction currencies
  • Random vs systematic failure treatment
  • Lifecycle and management of functional safety incl. competence

Key concepts: Functional Safety Foundations

Functional safety management
Planning, competence, documentation and assessment wrapped around technical work.
Random vs systematic
Hardware wear-out/chance failures quantified statistically versus design/process errors controlled by rigor.
Risk reduction allocation
Distributing required risk reduction among mechanical design, safeguards, control functions and procedures.
Safe state
The defined condition a function drives the equipment to on demand or fault.

Frequently asked questions: Functional Safety Foundations

Why can't testing alone prove safety?

Rare-event targets (like 1e-7/h) are unverifiable by test duration, and systematic errors evade random testing — hence the standards' dual machinery of quantified hardware analysis plus process rigor and independent assessment.

Standard information based on the published text of Functional Safety Foundations. Event content is provided by the host. For authoritative guidance, consult the official standard body.