Title: Standard for Fail-Safe Design of Autonomous and Semi-Autonomous Systems
Scope: This standard establishes a practical, technical baseline of specific methodologies and tools for the development, implementation, and use of effective fail-safe mechanisms in autonomous and semi-autonomous systems. The standard includes (but is not limited to): clear procedures for measuring, testing, and certifying a system’s ability to fail safely on a scale from weak to strong, and instructions for improvement in the case of unsatisfactory performance. The standard serves as the basis for developers, as well as users and regulators, to design fail-safe mechanisms in a robust, transparent, and accountable manner.
Need for Project: Autonomous and semi-autonomous systems which remain operational after an intended or unintended malfunction can disadvantage and harm users, society, and the environment. There is a need for a definition of effective fail-safe mechanisms to help mitigate risks related to system malfunction and provide developers, installers, and operators with clear technical criteria to terminate unsuccessful or compromised operations in a safe and consistent manner.