AI testing, evaluation, verification and validation for accessibility: a comprehensive framework

As artificial intelligence (AI) systems continue to remain prevalent in society, ensuring their accessibility for all users, including those with disabilities, is of great importance. This paper presents a comprehensive framework for AI Testing, Evaluation, Verification and Validation (TEVV) focused on accessibility. The proposed methodology incorporates methods for red teaming, model testing, and field testing with a particular emphasis on usability testing for accessibility. The results demonstrate, through detailed case studies, that systematically evaluating AI systems for accessibility barriers and biases improves the inclusivity and effectiveness of AI technologies for diverse user populations. The findings suggest that this accessibility-focused TEVV framework provides a structured approach for developing more equitable and universally usable AI systems that benefit all members of society.