ISO/IEC TR 24027

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization.

ISO/IEC TR 24027 is a Technical Report for Information technology — Artificial intelligence (AI) — Bias in AI systems and AI aided decision making.

Why are ISO/IEC TR 24027 tests important?

This Model Test policy focuses on the testing of AI models for bias.

It emphasizes the importance of rigorous testing procedures and metrics to ensure the model’s performance meets the expected standards and behaves as intended.

How does FAIRLY perform ISO/IEC TR 24027 tests?

For the list of metrics specified by ISO/IEC TR 24027, the fairly custom agent performs the tests to collect the metrics using industry standard libraries to ensure complete transparency.

Details and formulas of the metrics are detailed in the in-app reports. (They are not published here due to ISO licensing requirements.)

‍

‍