Tools and toolkits for responsible research assessment in data and AI

This report presents the work of Workstream 3 of CoARA-ERIP, whose objective is the development of a comprehensive toolkit for the implementation of best practices in research assessment for data and artificial intelligence. It covers the five Workstream 3 deliverables in a single account: the toolkit for the evaluation of digital contributions to science; the digital toolkit for responsible research assessment; technology-based tools, centred on the Modular Assessment Configurator; subsystem mapping, carried by the CoARA-ERIP Observatory; and innovative tooling, where the report gives a full treatment of research objects and badging. For each deliverable it states what has been built, what has been piloted, and what remains. It records how the workstream’s understanding matured, from early proposals for AI-driven assessment models towards governed, human-reviewed tools for evidence mapping and self-evaluation. It sets out a CoARA-ERIP position on badging, in which badges are verifiable attestations of facts about a contribution that enter an evidence map, and are never counted, summed, or used as scores.