Verification of Quantitative Results of National Project Activities Based on Large Language Models

The paper considers the task of automated verification of Russian national project activities by their quantitative outcomes. The source of information is a package of reporting documents submitted by the executor to the oversight body. The composition of the package is not known in advance, and the documents are heterogeneous in type and informational nature. A simple summation of numerical values from such documents yields an inflated result, since one transaction is typically reflected in several documents at once. The paper proposes a verification architecture that uses three sequential paths: summation over a series of uniform primary documents, comparison with the maximum among aggregate documents, and a deduplicated sum obtained with a language model. The paths are ordered by decreasing degree of trust in the result. The architecture has been implemented within a software pipeline and tested on real document packages. The scientific novelty lies in the hierarchical organization of paths, where the probabilistic method is engaged only when the other methods have failed.