Explabox: A Python Toolkit for Standardized Auditing and Explanation of Text Models

Developed to meet the practical machine learning (ML) auditing requirements of the Netherlands National Police, Explabox is an open-source Python toolkit that implements a standardized four-step analysis workflow: explore, examine, explain, and expose.The framework transforms models and data (ingestibles) into interpretable reports and visualizations (digestibles), covering everything from data statistics and performance metrics to local and global explanations, and sensitivity testing for fairness, robustness, and security.Designed for developers, testers, and auditors, Explabox operationalizes the entire audit lifecycle in a reproducible manner.The initial release is focused on text classification and regression models, with plans for future expansion.Code and documentation are available open-source at https://explabox.readthedocs.io.