ISO/IEC AWI TS 42119-8Under development

Artificial intelligence — Testing of AI — Part 8: Quality assessment of prompt-based text-to-text systems that utilize generative AI

Intelligence artificielle — Test de l’IA — Partie 8: Évaluation de la qualité des systèmes texte-à-texte à base d’invites qui utilisent de l’IA générative

Abstract / scope

This document provides definitions, concepts, requirements and guidance related to assessing prompt-based text-to-text AI systems that utilize generative AI. It covers quality assessment (which encompasses safety) using methodologies including red teaming and builds on existing standards such as ISO/IEC 23282 and ISO/IEC 42119-7. Additionally, it details methods for analyzing and interpreting results, as well as best practices for documentation